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ABSTRACT . A new class of nonstationary stochastic processes is introduced 
and some of the essential properties of its members are 
investigated. This class is richer than the class of stationary 
processes and has the potential of modeling some nonstationary 
time series. 

Let X n be a second order stochastic process with mean zero 
and covariance 

R(m,n) - EXjjPC n . 

A stochastic process X n is called stationary if R(m,n) depends 
only on m-n, i.e., if R(m,n) - R(m+l,n+l), for all m,n€Z. The 
process X n is called periodically correlated with period T if 

R(m,n) - R(m+T, n+T) for all m,neZ. 

As a natural extension of these well-known stochastic processes, a 
linearly correlated processes is defined to be one for which there 
exist scalars aj such that 

R(m,n) - Xa-j R(m+j , n+ j ) , for all m,n€Z. 

j J 

v 

The relation between these newly defined processes with other 
important classes of nonstationary processes is investigated. 
Several examples of linearly correlated processes which are not 
stationary, periodically correlated, or harmonizable are given. 
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1. INTRODUCTION . The purpose of this paper is to introduce a new class of 
stochastic processes which contains all stationary and periodically 
correlated processes as well as some other interesting processes such as the 
Wiener process. As will be seen, this new class is a natural extension of 
the well studied class of stationary processes. 

As we all know, a zero mean second order stochastic process X n , neZ, is 
stationary if 

R(m,n) - R(m+1, n+1) ; for all m,neZ, 

where R(m,n) - EXmXn is the correlation function of the process X n . In other 
words, for *n to be stationary, R(m+r,n+r) must be the same for all integers 
r. Since for many time series in practice, R(m+r,n+r) does not stay the 
same for all r, it is then not appropriate to model them as a stationary 
process. However, for our new class, R(m,n) does not have to be equal to 
R(m+l,n+l) or R(m+2,n+2), etc., but equal to a linear combination of these 
correlations. So some time series can be modeled more accurately as a member 
of this new class. 

Recently, there has been a considerable interest in studying classes of 
nonstationary processes [2], [3], [4]. One of these classes which again 
extends another aspect of stationary processes in a very natural way is the 
class of harmonizable processes. For the definition and properties of 
harmonizable processes and some other classes of nonstationary processes, the 
reader is referred to the interesting exposition [1] and the references 
therein. 

In section 2, we introduce our new class of nonstationary processes and 
give a few examples and some preliminary discussion regarding them. In 
section 3, we study some basic properties of this new class. In particular, 
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we will look for cheir relations with the class of harmonizable processes and 
the support of their power spectra. 

2. LIMMLY CORRELATED AND CONVEXLY CORRELATED PROCESSES . In this section 


we introduce our new class of nonstationary stochastic processes which is a 
natural extension of the well-known classes of stationary and periodically 
correlated processes. We also recall some definitions and results which are 
needed throughout this paper. 

The classes of linearly correlated and convexly correlated processes 
which we introduce shortly are much richer than that of stationary processes 
and hence can serve us better for the purpose of time series modeling. As an 
example, an important nonstationary stochastic process is the Uiener process 
W n , neZ, whose correlation function is given by 

I min(m,n) ; m,n > 0 


R (m.n) - 


| 0 ; otherwise 

One can see that this important process is not even harmonizable (see 
Definition 2.7). Nevertheless, we will see that W n is a linearly correlated 
process. In fact, although R(m,n) is neither equal to R(m-1, n-1) or R(m+1, 
n+1) , it is equal to their average, namely 

R(m,n) - h R(m-l,n-l) + h R(m+l,n+l), 

for all positive integers m and n. This then shows that the Uiener process 
W n is in the new class (see Definition 2.1 and Remark 2.3). 

Let (fl,/J,P) be a probability space and *h. neZ, be a sequence of random 
variables on this probability space. Throughout, we assume our stochastic 
process X n to be of second order, namely E|X n |^ < ® for all n, and to have 
zero mean, namely EX n - 0 for all n. 

Now, let's introduce our new class of nonstationary processes. 
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2.1 DEFTNJTION . Let X n , neZ, be a zero mean second order stochastic process 
and let S be a subset of Z. The process X n is called linearly correlated on 
S if there exists a positive integer p and some complex numbers a j , j-0, ±1, 
±2 , . . . , ±p such that 

P 

(2.2) R(m,n) - S aj R(m+j , n+ j ) , for all m, neS. 

m-i 

2.3 EXAMPLES . As we know, a process X n is called stationary if its 

correlation satisfies the relation. 

R(m,n) - R(m+1, n+1), for all m,n€Z, 
and hence (2.2) with p-1, a.]_ - 0 and a^ - 1. So any stationary process is 
linearly correlated on Z. 

(b) A process x n is called periodically correlated with period q if its 
correlation function satisfies 

R(m,n) - R(m+q, n+q) , for all m,n€Z, 
and hence (2.2) with p-q, aq - 1 and all the other aj equal to 0. So all 
periodically correlated processes are linearly correlated on Z. 

(c) The Wiener process W n mentioned before is linearly correlated on the set 
of positive integers. This is because one can easily check that 

(2.4) R(m,n) - h R(m+l,n+l) + H R(m-l,n-l), for all m,n > 0. 

In fact, if m,n are two positive integers with say m^n, then (2.4) reduces to 
n - h (n+1) + h (n-1) 
which is clearly true. 

(d) Let X n be a stationary process and a be any complex number. Consider 
the stochastic process 

Y n “ a n X n . 

Then one can show that Y n is periodically correlated on the set of all 
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integers. 


In fact, one can see that the correlation function of Y n satisfies 

R(m,n) - — L — R (m+1, n+1) + |ft l 2 R (m-1, n-1) 

| a | ^+1 | a ^+1 


for all m t r\eZ . 

(e) Let X n be a stationary stochastic process and consider the process Y n 
defined by 

Y n - nX n . 

Then one can easily check that 

R(m,n) - 3R(m+l,n+l) - 3R(m+2,n+2) + R(m+3,n+3), for all m.neZ. 
Hence Y n is linearly (even convexly) correlated. 

Notes. (a) The linearly correlated process of example (d) is not 
periodically correlated unless |a| - 1. This is because in this example, 
E|X n | 2 goes to ® with n. While for a periodically correlated process, these 
quantities stay bounded. 

(b) One can find other examples by replacing the stationary process 
of examples (d) and (e) by a periodically correlated process. 

An important class of non- stationary processes is that of harmonizable 
processes. It is thus’ essential to study the relations (if any) that exist 
between our classes of linearly correlated and convexly correlated processes 
introduced here and the class of harmonizable processes. We postpone this 
study until the next section. However, here we would like to recall the 
definition of harmonizable processes as well as some of their properties that 
we will need in the next section. For more detail on these, see [1], [5], 

2.7 DEFINITION . A process X n is called strongly harmonizable if its 


correlation function can be represented as 


( 2 . 8 ) 

where F is 


R(m,n) - J 2 e 6) d F(A,0), 

a complex-valued measure on the unit interval 


I 2 -[0,2w]x[0,2jt] 
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which is of finite Vitali variation. It is called weakly harmonizable if one 
has the relation (2.8) with F being only a bimeasure with finite Frechet 
variation on I^. In either of those cases, F is called the spectral measure 
of the process X n . 

2.9 DEFINITION . Let X n be a second order process, so that the Xj/s belong 

to H-L^(fl,/3 , P) . X n is said to have stationary dilation if one can find a 
larger Hilbert space K 2 H and a stationary process Y n eK such that 

X n - PY n ; for all neZ, 

where P is the orthogonal projection of K onto H. 

The following useful result is now well-known, (cf. [1], [5], [6]) 

2 . 1 0 THEOREM . A second order process Xn is weakly harmonizable if and only 
if it has a stationary dilation. 

Finally, it is well-known that any stationary process is strongly 
harmonizable and its spectral measure is concentrated only on the diagonal 
D— of I^. It is also known (see [4]) that every periodically 
correlated process with period q is also strongly harmonizable. However, in 
this case, the spectral measure is supported on 2q-l equidistant straight 
lines parallel to the main diagonal of 1^, namely on the lines 
D k - <{(A.tf); k - 0,±1 ±(q-l) 

q 

3. linearly and convexly correlated processes and their harmonizability . In 

this section, we will study the relation between our newly introduced 
linearly and convexly correlated processes *and the harmonizable processes. 
As we have shown, stationary and periodically correlated processes are both 
linearly correlated and harmonizable. Thus, the following questions are 
natural to ask and reasonable answers to them seem essential for any further 
study of the linearly correlated processes. 
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QuescioQ 1 . Are all linearly correlated processes strongly harmonizable? 


Question 2 . For those linearly correlated processes which are strongly 

harmonizable, what is the support of their spectral measure? 

The answer to Question 1 is negative: To see this, consider the linearly 

correlated process Y n - 2 n X n of Example 2.6. If this process were strongly 

harmonizable , then 

R(m,n) - J* e -i(®A-n0) dF(A,0), 

I 2 

for some spectral measure F which is of finite Vitali variation. Thus 

| R y (m, n) | < f | e -i<®*-n*)|d||F||(A,*) 

I 2 

and hence 

|R y (m,n)| £ || F|| (I , I) < « 

for all m,n6Z, i.e. R y (m,n) must be bounded which clearly contradicts the 
fact that R y (n,n) - 2 2n R x (0,0) goes to «> with n. 

This then closes Question 1, but instead raises the following: 

QueM£l°n 2 ‘ Is there any linearly correlated process, other than the 
stationary and periodically correlated processes, which is weakly 
harmonizable? 

Question 4 . How about if we replace weakly with strongly in Question 3? 

In this section, we first address Question 2 furnishing a complete answer 
to that (see Theorem 3.1) and then prove some other related results. At the 
end of this section, we give a partial ariSwer to Question 3 (see Theorem 

3.11) by proving a dilation result (see Theorem 3.7) as well as giving an 
example showing the answer to Question 4 is on the positive side (see Example 

3.12) . 

The following theorem gives a complete description of the support of the 
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spectral measure of linearly correlated stochastic processes. 

3.1 THEOREM . A strongly harmonizable stochastic process Xn is linearly 
correlated if and only if its spectral measure is concentrated on a finite 
number of straight lines parallel to the main diagonal of I 2 (not necessarily 
equidistance) . 

PROOF . Suppose that the spectral measure F of a stochastic process Xn is 

concentrated on say k straight lines parallel to D - -{(A.0): A-0^, so one can 

find real numbers d j , j -1, 2, k such that the support of F is on 

k k 

the set u ^(A,0): 8 - A + d; [■. Since the function n -e^j) 

j“l j-1 

vanishes on the support of F, we can write 

k 

(3.2) J e -i(^~8n) n ( e -i(A-0) . e id j) dF(A,0)-O for all m.neZ. 

I 2 j-1 

Multiplying the product in (3.2) out, we get 

k 

S e _i ( Am * n *> (2 Cj(e‘ i ( A ' tf )j) dF(A,0)“O, for all m.neZ. 

I 2 j-0 

This means 

k 

2 c-j R(m+j , n+ j ) — 0, for all m,neZ, 

j-0 J 

which clearly means that our process X n is linearly correlated. Conversely, 
suppose X n is a linearly correlated process which is strongly harmonizable. 
So we have 


k 

R(m,n) -2 aj 

j-0 J 


R(m+j , n+j); 


for all m,n€Z. 


Without loss of generality, we can take aj-0 for all negative j's. 
all m.neZ, we can write 


So, for 
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k 

f e~ i ( nX ~ ng > dF(A,0) -2 a< f ( dF(A,0), 

I 2 j-0 I 2 

or 

k 

j e -i(mA-n0) {1 _ 2 a e -ij(A-0)] d F (A,tf)«»0. 

I 2 j-0 

k 

This means chat 1- 2 a^ e*lj( A '^)-0 for a.e. (A,0) with respect to the 

j-0 

measure dF. Thus, the support of F must be included in the set 
k 

■{(A,0)el 2 : 2 a-j e‘*0( A ‘^ -1^ for A -6. Solving the equation 2 a^ e"*-j( A “^)-l 

J-1 

for A -6 and listing its distinct real solutions by d^, d2, . ..d^g, we conclude 
that the support of F is included in the set 

i 

U -{(A,*): X-0 - dA 

j-1 

consisting of 2 straight lines parallel to the main diagonal of I 2 . 

The last theorem gives a complete description for the support of the 
spectral measure of a harmonizable linearly correlated process. Its support, 
as in the case of stationary and periodically correlated processes, is on a 
finite number of straight lines parallel to the main diagonal. However, now 
these lines do not have to be equidistant. 

3.3 REMARK . One can easily check that for strongly harmonizable stochastic 
processes every linearly correlated process is convexly correlated. In fact, 
if we have a linearly correlated process whish is strongly harmonizable, then 
as we saw in the second half of the proof, its spectral measure is 

2 

concentrated on u -{(A,0): A -8 - -dj }■. So 

j-1 
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n -e id J) - 0 a.e. dF 

j-0 

where do - 0. This means chac 

i 

f -i(oA-ntf) ji ( e *i(l-0) _ q, for all m,n£Z. 

I 2 j-0 

Expanding the produce and writing Che resulting equation in terms of the 
correlation function, we get 

i+1 

2 b< R (m+j,n+j)-0; for all m,neZ, 
j-0 

where b^+i - 1 and the other bj ' s come from 

2 +1 bj £ (e i(A-tf> . e idj) 

j-0 j-1 

If we put 0 for X-6 on both sides of (3.4), we get 

1 1 

1+2 b< - 0 or 2 (-bj) - 1 

j-0 j-0 

This fact together with (3.5) proves our claim. 

Let's call a process positively convexly correlated if it is convexly 
correlated and if its correlation function satisfies 
P P 

3.5 ^ R(m,n) - 2 a< R(m+j,n+j), with 2 a-t - 1 and 2 0 for all j. 

|j|-l J J 

The following result is somewhat surprising. 

3 . 6 THEOREM . The only positively convex!^, correlated processes which are 
strongly harmonizable are the periodically correlated ones. 

PROOF. Let X n be a positively convexly correlated process satisfying (3.5). 
Suppose also chac X n is strongly harmonizable with spectral measure F. As in 
the proof of Theorem 3.1, we see that the support of F is included in the set 
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p 

« (A ,0): 2 ai e'ij( A -*>-l - 

I IJl-1 ^ f 

which can be rewritten as 


P P 

(A, 5): 2 a-i cos j(A-0)-l and 2 sgnj a-j sin j (A - 9 ) - 0}-. 

IjI-i Ij l-i 

p 

Now, since all a-j >0 and Sa-s-l, one can see that E a a cos 1(A-0)-l is 

j j ui-i j 

possible only if cos j(A-0)-l whenever aj + a.j * 0. So, letting 

S - { j : aj + a.j * 0), we conclude that the support of F is included in the 

set n ■{(A,0): cos j(A-0)- 1^. Let q be a common divisor for the integers 
jes 

in S . Then one can see 

q-1 

n H <A, ) : cos j(A-0)- 1}- C U -{(A,*): A-0 + 

jeS n--q+l ^ 

Thus, F is concentrated on 2q-l lines 

«{<A.0):A - 6 + n-0, ±1 ± (q-1). 

q 

This in turn means that 

j* e -i(mA-n0) (e ic l( A -* > -1) dF(A,0)-O, for all m.n. 

I 2 

This, rewritten in terms of the correlation function gives 
R(m,n) - R(m+q,n+q), for all m,n6Z. 

Thus, X n must be periodically correlated with period q. 

Now, we turn to Question 3. However, before that we prove the following 
dilation theorem which is crucial for our development. This theorem is of 
course of independent interest. This not only shows that a class of convexly 
correlated processes have a stationary dilation, but also gives the precise 
form of their stationary dilation processes. 
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We say a process is one-sided positively convexly correlated if its 


correlation function satisfies 


(3.7) 


-1 

R(m,n) -2 a-i R(m+j,n+j), 
j-P 


with aj a 0 and 2 aj “ 1 . 


1 

j— P 

3 . 7 THEOREM . Any one-sided positively convexly correlated process has a 

stationary dilation. 

PROOF. Let Y n - [c. p+1 X n . p+1 , c. p+2 X n . p +2, ••• c O x nl be a vector random 
process with values in the Hilbert space HP, with cq—1 and, for -p+1 -1, 

Cj is any complex number satisfying 


(3.9) 

It is quite clear that 


, 1 2 i ' 1 
I C j | “ 2 a^ 

k-p 


X n - £ Y n ; for all m,neZ, 

where PrH^ -» H is the orthogonal projection sending each element of to its 
first component. So we must show that Y n is actually stationary. To show 
this , we need to check that 

(Y n , Y m ) - (¥„_!, Y m .!). 

To see this, consider the expression 

(Yn- 1 * Y m .!) - (Y n , Y m ) - 
P <r V 

2 l c -p+il 2 R(n-p-l+j, m-p-l+j ) -2 |c_ p+ j| 2 R(n-p+j, m-p+j) 

j-1 j-1 
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I c -p+ll 2 R(n-p, m-p) + 2 |c. p+ j| 2 R(n-p-l+j, m-p-l+j) 

j-2 

p- 1 

- 2 |c. p+ j| 2 R(n-p+j , m-p+j)- |co| 2 R(n,m) 

j-l 

p-1 

|c.p+i| 2 R(n-p, m-p) + 2 ^l c -p+j+ll 2 R(n-p+j , m-p+j) 

p-1 

- 2 |c. p+ j| 2 R(n-p+j , m-p+j)- |Co| 2 R(n,m) 


(3.10) 


p-1 


“ I c -p+l 1 2 R(n-p, m-p) +^2^ ^ | c . p+J +1 1 2 - l c -p+jl 2 j R(n-p+j, m-p+j) 

- | cq 1 2 R(n,m). 

Now, from (3.8) we see that 
( i) |c 0 | 2 - 1 

, .9 ' P 

( i 1 ) l c -p+ll - 2 - a.p, 

k— p 

-p+j -p+j-1 

(iii) I c -p+j+l | 2 - | c - p+j | 2 - 2 a k - 2 - a. p+ j , for l^j^p-2 

k--p k--p 

( iv) Adding the equations in (ii) to those in (iii), we get 

-2 -1 

|c.i| 2 - 2 a k - - 2 a k - a. X - 1 -a.j., 

k--p k--p 

which gives the coefficient |c. p+ j + ]J 2 - |c. p+ j| 2 in (3.9), for j - p-1 to be 

I c 0 1 2 - l c -ll 2 “ 1* (1-*-!) - «-l. 

Substituting from (i)-(iv) in (3.10), we get 


(Y n -l.Y m .i)-(Y n ,Y m ) - 2 aj R(n+j),m+j) - R(m,n) 

j-P 


which is zero by (3.7). 


Q.E.D. 
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We can now prove the following which provides a partial positive answer 
to Question 3. 

3.11 THEOREM . Every one-sided positively convexly correlated stochastic 
process X n is weakly harmonizable . 

PROOF . Since by Theorem 3.8 the process 3^ has a stationary dilation. The 
proof can be completed by appealing to the main Theorem of [5] which says: A 

stochastic process is weakly harmonizable if and only if it has stationary 
dilation. 

In connection with last result, one may ask whether linearly correlated 
processes are weakly harmonizable. The answer is no. For instance, the 
examples (d) and (e) mentioned in section 2 can not be weakly harmonizable. 
Because any weakly harmonizable process having a stationary dilation should 
have a bounded sequence of variances and this was not the case for these 
examples (as we noted before) . 

The following example shows the answer to Question 4 on the positive 

side. 

3.12 EXAMPLE . Let Z(’) be an orthogonally scattered stochastic measure on 
[0,2n] and define a new stochastic measure Y(’) on [0,2ff] by 

Y(A) - Z(Afi[0,2jr]) + Z(An[0,2»r] -Jl) 

where B-a - ^b-a:eB}-. Consider the strongly harmonizable processes 

X n - JV in *dY(0) 

One can easily see that the spectral measurfe' of Xjj is concentrated of the 
diagonal X-9 and lines X-Q-±Jl of 1^. By theorem 3.1 Xjj is linearly 
correlated and it is clearly not stationary or even periodically correlated. 

Another important feature of stationary processes which turns out to be 
extremely useful is the existence of a unitary shift. However, when it comes 
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to nonstationary processes, even the existence of a shift operator is not 
always guaranteed [3], So, it is nice to know when a nonstationary process 
does have a well-defined shift and if it does have one whether it is bounded. 

We conclude this work with the following result which examines the 
existence of shift operator and its boundedness for a positively linearly 
correlated process. 

3.13 THEOREM . Let X n be a positively convexly correlated process whose 

correlation function satisfies (3.5). If aj, > 0, then ^ has a bounded 

shift. If a.]_ > 0 too, then its shift is boundedly invertible as well. 

PROOF . . Take any finite linear combination 2 b k X k X k 's, then we can write 

I! 2b k X k || 2 - 2 b k b k < (X k ,X k * ) 
k k,k' 

- 2 b k b k * T 2 aj (X k+ j , X k * + j)l 


- S .j r X b k V (X k ,X k ')-| - X aj I X b k X k+J I 2 

IjI-i J 1j l-i 

This implies that 

(3.14) || 2b k X k || > || 2 b k X k+1 || 

k k 

Now if > 0, it is quite clear from (3.14) that the shift operator defined 
via 

U (Sb^X^) — 2 b^Xj^+l 

is well defined and bounded. This completes the proof of the first part. 
The second part can be proven similarly using the inequality: 


II 2bk*k || * Va-! || 2 b k X k _x || 
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3 15 R EMaRK . In chis present work we have only considered discrete time 
processes. We are planning co study continuous time linearly correlated 
processes in future. It looks like they have nice applications In 

I 

engineering. For example'; in analyzing the helicopter noise wh££e" the sound 
reaching an observer consist of two periodically correlated random noise 
processes generated by the main and call rotors. Ordinarily, the periods of 
these two signals are incommensurate. One can see that the helicopter noise 


is then nor* periodically correlated. However, 


chis continuous time 


processes* 


turns out co be linearly correlated and harmonlzable. This application is 


illustrated in the following figure. 


HELICOPTER NOISE FIELD 



Observe/ 


P(t)=P 1 (t)+P 2 (t) 
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